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This docufnent presents a niodel and description of a 
systematic institutional performance appraisal instrument* Particular 
eniphasis of the instrument is focused on the strengths and weaknesses 
of the structure that supports the university's operation toward goal 
achievement. The instrument is intended to be elementary because it 
is believed that no sophisticated performance evaluation system 
installed without systematic inteinal self-evaluative experience 
would work. (HS) 



ERIC 



•OM PrST A'.'AIUPLi; 




THEORY AND SUGGESTED FRAMEWORK FOR 
SELF-EVALUATIVE PERFORMANCE APPRAISAL 
IN THE UNIVERSITY 



by 



James Steve Counelis 



. THE UNIVERSITY OF SAN FRANCISCO 

Office of Institutional Studies 

O 



THEORY AND SUGGESTED FRAMEWORK FOR SELF-EVALUATIVE PERFORMANCE APPRAISAL 

IN THE UNIVERSITY 

by 

James Steve Counelis 



San Francisco, California 
January 2, 1973 



1 1 



PREFACE 



The subject of this report was suggested by the Reverend wniiam 
C. Mclnnes, S.J., President of the University of San Francisco, It was 
his idea and hope that systematic performance appraisal could be approached 
with advantage from the viewpoint of the seif-evaluat1on of the university's 
strengths and weaknesses, particularly emphasis at the beginning on the 
structure that supports the university's operation toward goal achievement. 

This report attempts to present for the Institutional level of 
the university an holistic systematic approach which theoreticany 1s sound. 
The suggested format for a Self-Eval uati ve Performance Appraisal Report Is 
intended to be elementary, indeed ''primitive,'' in that no sophisticateli per- 
formance evaluation system installed de novo in an institution without sys- 
tematic internal self-evaluative experience would work. That is the pres- 
ent stage of organizational development 1n the University of San Francisco; 
and I suspect the same 1s true in even the most prestigious institutions of 
higher learning in the United States. Further, the Self- Evaluative Perfor - 
mance Appraisal Report does not comprehend personnel evaluation because per- 
sonnel appraisal procedures are of a different order than that of institu- 
tional units. Hence another study in that area is warranted. 

There is nothing new or revolutionary in the ideas suggested here. 
What will be revolutionary 1s their direct empirical application, if that 
comes to pass. The empirical institutional fact that is the hope of the 
approach suggested here is the self-informing function which would have a 
beneficial cybernetic effect upon university operations and achievement. 
To that end, one must be an incurable optimist. But moreso, one must also 
be an incurable realist, knowing that the survival of American private 
higher education, and the University of San Francisco in particular, is 
dependent upon sensitive reality- testing mechanisms. The Self-Evaluat ive 
Performance Appraisal Report is designed to be one such real ity-tesling~ 
mechanism. 

Again, I am pleased to note the aid of my staff. Mr. William J. 
DUlon Associate Director, was most helpful in his critical comments. 
And Miss Diane Pederson completed with excellence the typing, proof-reading 
and drafting required by this report. I am indebted to them. 

Of course, the final responsibility of this report rests with me, 
as it should. Whatever its merits and defects, I hope that there Is some 
utility found herein. 

JSC 

Oanuary 2, 1973 

The University of San Francisco 
San Francisco, California 94117 
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IN THE UNIVERSITY 



by 



James Steve Counells 



FramewQrk : 

As conceived heres the framework for self-evaluative performance 
appraisal In the university consists of three fundamental elements. These 
are: (1) program goals {PJ\ (2) budgeted goals (J^); and (3) operational 
results {0). 

Definltionally the term "program goals'' (£) refers to the norma- 
tiveiy intended achievements for the university. The term "budgeted goals" 
(B^) denotes those normatlvely intended achievements invested with resource 
allocations. With the term ^'operational results'* {OJ , reference is made to 
the actual results, holistlcally obtained through the applied resource in- 
vestment per normatively intended achievement. In the university context, 
the following relationship obtains: 

E - f P. B, 0. [1] 

Symbolic Proposition No, 1 reads: Self-tvaluat1ve performance appraisal 

^Dr. James Steve Counells is Director of the Office of Institu- ■ 
tlonal Studies and Associate Professor of Education in the School of Edu- 
cation in the University of San Francisco, San Francisco, California 94117. 
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(£) 1s a function (f) of program goals (P), budgeted goals (B ) , and opera- 
tional results (0), However the nature of this functional relationship 
needs further definitional clarity, 

Evaiiiation Defined: 

— — ^ - "- I 

The criterion probleni is the crux of all evaluation. Within this 
framework j the criterion 1s found 1n the specifically stated program goals 
(£), viz . , the specifically stated normatively intended achievementsof the 
university. The guidance function of program goals (Pj 1s always acknow- 
ledgid; but program go^ls (P) are not used systematlcaVly 1n an empirical 
manner. The suggestion 1s made here that the university's program goals 
(P) be taken seriously 1n an empriical sense. Surely If they are intended, 
they must be observable. If they are observable to someone on campus, 
they should be observable to all. 

Admitting that the university's program goals (P) are general In 
character does not vitiate their observable quality. And when one program 
goal (£) is allocated resources, the budgeted goal , (B) ought to become 
more clearly perceived in empirical terms. It is when the budgeted goals 
(B.) and the actual results, here called genericany by the term "operation- 
al results" (O), are compared and contrasted that evaluation obtains. 

Put at a more generic leveU 1t is the function of program goals 
(P) to provide specific guidance to the university's resource allocation 
patterns. It Is the function of budgeted goals (B) to delineate In empiri- 
cal and programatic terms the goals marked for achievement. And it 1s the 
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function of operational results (pj to embody the achleyenient stated in 
the budgeted goals (£) which in turn reflects the overall university pro- 
gram goals and mission The key terms in evaluation are those of coni- 
parison (similarity) and contrast (difference) between criterion (P and B) 
and results (0). Symbolically, seTf-evaluati ve performance appraisal in 
the university (£) is defined: 

E = fP^C(B^.O^) , (B^ = 0^)]. [2] 

Symbolic Proposition No, 2 reads: Self-evaluative performance appraisal . 
ig) is defined as a function of the similarities (B^O) and differences 
(B » 0) between budgeted goals {B) and operational results (0) under direct 
guidance of the university's program goals {£). 

Tests of Institutional Achievement : 

The pragmatic test of institutional achievtment of the university 
1s in the degree of Isomorphy among the elements of evaluation, vfz . , pro- 
gram goals (P), budgeted goals (B^), and operational results (0). A low 
degree of Isomorphy among P, B, and 0 indicates a low level of achievement, 
a ''red flag" for self-examination and feedback for corrective action. A 
high degree of isomorphy indicates substantive achievement of intended 
' goals* Symbolic representation of the test of isomorphy is indicated as 
follows: 

^ f P 5 B i 0 . . [3] 
n n n n ^ 



Symbolic Proposition No, 3 reads: Achievement (A ) is a function of the 

n 
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degree of isomorphy or identity among program goals (P^)i budgeted goals 
(B^), and operational results {O^)^ each goal taken individually rather 
than severally. 

In Symbolic Proposition No. 3 there are three relationships that 

produce the intended isomorphy among P , B , and 0 . These are: (1) 

— n 

P SB; (2) P 5 0 ; and (3) B 50, These three relationships provide 

n n n n n n ^ r 

the analytical tools for achievement accountability. The statement P = 8 
^ J n n 

asserts formal and substantive agreement to be found between particular 
program goals (P^) and particular budgeted goals (^), The statement P^ s 
0 asserts the formal and substantive agreement to be found between par- 
ticular program goals (P^) and particular operational results (0^)* The 

statement B s 0 asserts the formal and substantive agreement to be found 

" n n " - - 

between particular budgeted goals and particular operational results. In 
institutional self-evaluations these three analytic propositions collec- 
tively provide the specific pragmatic test analysis framework and hopeful- 
ly these help to "zero in" on the focal point of disparity between achieve- 
ment and non-achievement for each reporting unit's specific goals takeri 
individually and severally. 

Institutional Structural Dimensions : 

There are two structural dimensions to the university. The ver- 
tical dimension designates the hierarchical levels of university organiza- 
tion. These levels are: (1) universi ty="as-a-whole level (U^); (2). school/ 
college level (C); (3) departmental level [D), ive., academic and non- 
academic; (4) personnel level (l)^ 1,e,, the individual professional and 
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support staff people. | 

The liorizontal dimension of the university designates the general 
university elements which cut across all the hierarchical levels. These 
general elernents are: (1) faculty (F); (2) curriculum (K); (3) students 
and (4) milieu (M). Within milieu (M) is- comprehended the following: 
(a) mnieu-administratlon (M^); (b) milieu-governance (M^); (c) milieu- 
plant/environment (M^)- (d) milieu-external relations (M ). The cross 

. . ^~e 

classification of these two dimensions provides a systematic pinpointing 
of areas in the university structure in which self-evaluative performance 
appraisal can take place. The attachnient of particular program goals (P), 
budgeted goals (B), and operational results (0) to the university's organ- 
ization by areas provides a systematic plan or format to "blanket" the uni- 
versity in its entirety. See attached chafts. 

Suggested Institutional Report Format : 

The attached form is provided to suggest guidance to the theo- 
retical framework provided herein for self-evaluative performance apprais- 
al. Knowing that institutions need training in the installation of new 
procedures, the attached form 1s deliberately structured to allow each re- 
porting unit to state its own "perception of goals" at the program and 
budgeted levels (£ and B) and to document empirical achievements at the 
end of the fiscal year. It Is hoped that this report and the attached 
form provide a useful starting place for university sslf-evaluation to 
begin in earnest. 



THE UNIVERSITY OF SAN FRANCISCO 
Office of Institutional Studies 



SELF-EVALUATIVE PERFORMANCE APPRAISAL' REPORT 



Direc tions: 



Self-evaluation is the beginning of competence and the source of 
Improvement because of its cybernetic or self-informing character. This 
notion of self-evaluation is delineated pragmatically in the report docu- 
ment described below. In it are placed both the criterion and the results 
of self=exam1nat1on. Knowing that simplicity and empirical directness are 
most efficient as principles, the following format for a self-evaluation 
of performance is presented so that each university reporting unit presents 
a single pattern. This evaluation report can be done either as a group 
enterprise or by the university unit's reporting officer. 

The Self-Evaluative Performance Appraisal Report requires the 
foil owing five parts. Each part is defined. 

. (1) Program Goals (P): For this report, the term "program goals" 
refers to the normatively intended achievements of the reporting unit 
for the current fiscal year. Hence, the university unit's report 
should list its normatively IntenQed achievements for the current fis» 
cal year* 

(2) Budgeted Goals {£}: For this report, the term "budgeted 
goals" refers to those normatively Intended achievements invested 
with resource allocations for the given university unit's fiscal 
year* Hence, the university unit's report should list those goals 
for which resources had been budgeted for the fiscal year. 

(3) Operational Results (0): For this report, the term "opera- 
tional results" refers to the empirical achievements that were pro- 
duced through the application or investment of resources for given 
goals, vi2 > , P and Hence the reporting unit's report ought to re- 
flect empirically the results obtained for the fiscal year through the 
application of resources to the stated goals. 
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(4) Evaluation (£): For this report, the terni ''evaluation" re« 
fers to the degree of success and/or failure in goal achievement, 
using the criteria of goals given by each reporting unit in the first 
two parts of the report. Hence the reporting unit's report ought to 
reflect the documented reasoning for the outcomes obtained during 
that fiscal year, 

(5) Implications for Action : For this report, the term "im- 
plications for action*' refers to 'the meaning and import that the eval 
uation has for valuable university service In the next fiscal year. 
Hence the report should reflect such recommendations and their rea- 
soning as would effect the improvement of university service to our 
client students, the community-at-largej and the university commu- 
nity of scholars. 

It will be noted that the reporting units will be recording thei 
perceived goals under £ and B. And this is as it should be when the msti 
tution 1s launching a Self-Evaluative Performance Appraisal program In the 
university. As time goes on, these goals will shift with the needs and 
vitality of the Institution, calling for full study of university direc- 
tions every four or five years. 

Each Self-Evaluative Performance Appraisal Report is to note 
specifically the reporting unit, its chief officers the reporting officer, 
and whether the self-evaluation was a group or an individual enterprise. 
If it was a group enterprise, the names of the group appropriately must 
be included. The report 1s also to be dated and submitted with a brief 
letter of transmittal to: 

The Office of the President 
University Center 425 
Campus 

The length of the report will follow the needs and dictates of the report- 
ing unit. Supporting empirical evidence can be put in an appendix to the 
report. Such empirical evidence is encouraged. 
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TECHNICAL NOTES 



Note No. 1 ; There are three charts presented in this report. All of them 
are two dimensional charts involving the three dimensions of university or- 
ganization and evaluation patterns. However a three dimensional model is 
possible as well; but it would not be satisfactorily drawn. That would in- 
volve taking Chart No. 1. which presents a cross-classification of the hori- 
zontal and vertical dinitmsions of university organizition and attaching or- 
thogonally thi dimension of evaluation. Hence a cube with 147 cells is 
possible. 



Note No. 2: The text does not provide for a sunmarizing syinboUc proposi- 
tion for self-evaluative performance appraisal (E) for the university as a 
whole. This is achieved by the following proposition: 



he Proposition No. 4 reads; For the total university, self-evalua- 
tive performance appraisal (E ) is a function of the product (n) of the 
sums of the achievements for each evaluated unit ft A ) 

^— mn - ' 
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